DOCOHBIT BBSOBB 



BO 206 538 SO 013 562 

MITHOR' Jeasen, Eric L.: Bebster,*Da»ia . • " 

TITIB Ranking studies of 'Graduate Sociology Departments in 

"The American sociologist": 1965-1980^ , 
POB DATE Apr 81 * n 

KOTE 32p.: Paper presented at 'the Annual Meeting of the 

Anerican Educational Research .Association (Los 

Angeles, CA» April 13-17, 1981). 

EDBS PBICE HP01/PC02 Plus Postage. 

DBSCR^IPTORS ♦Departments : ^ Faculty : ♦Graduate School Faculty; 

Higher Education: ♦Intellectual Disciplines; 

Literature Revievs: Scholarly Journals; ♦Sociology; 

Tables (Data) ; Oniversities 
IDENTIFIERS ♦Ranlcing 

ABSTRACT ' ! 

This paper revievs ranking studies of graduate level 
college and university departaents of sociology ia ••The Aaerican 
Sociologist*^ froi its inception in 1965 through 1980* ^The American - 
Sbciologist«« va^ selected as ihe source of ra-nking studj^ps because of 
its function ••as an organ of information and discussion for the 
professional concferns of sociologists as a social collectivity and, 
specif icallyr because it has presented a large dumber of articles otf 
prestige within the discipline, studies reviewed in the paper are 
limited to those which deal with, the prestige or auality rankings of 
departments, the changing methods of ranking studies in sociology, 
divergent results- of bhe various methodologies used in the ratings, 
and mobility cf departments* over time* Host of the studies date fro* 
1965 through 1975 because editorial policy during' this period favcffed 
rating studies whereas editorial policy after this time discouraged 
them* Ranking studies discussed include four which rate the faculty 
of graduate sociology department b total productivity 
(Knudsen-Vaughan, .1969; Glenn-Villemez, 1970;* Oromaner, 1972; atnd 
Uoering, 1972) , and four w^ich' rate graduates by total productivity 
, (Vanderer, '1966; Knudsen-VaughUr 1969; Larson, Petronsky, and 
Vandiver, 1972: and Sturgis and Clemente, M973) • Findings from 
analysis of tabular and expository departmental rating data indicate 
that there exists a generally ag^reed*u^on elite among graduate 
sociology depatments (Harvard, OC Berkeley^v Columbiar Chicago, aind 
Hichlgan)', editors* of prestigious journals tend to be concentrated in 
thege same elite departments, and the status of the institution is 
ofteff a good predtet^r of departmental prestige. (DB) 
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The objective, of this pper is to review the ranking studies of 

t 

graduate departments of Sociology in -The American Sociologist from i€s 
inception in 1965 through 1980. The studies reviewed in this paper will be 
limited to those which 'explicitly rank graduate departments or critique 
^methods, of rating departments. -That is^ we will review studies which deal 
with the prestige dr quality rankings of departments but wilX, exclude those 
articles concerned with other dimensions of prestige such as regional 
productivity rates ^ variations in time spent obtaining the Ph.D. '.by 
pres.tige of department, studies of faculty promotion ih various 
departments, 'etc. Throughout this 'review" we will discuss studies which 
assess the changing methods of ranking studies -in sociology, the 'divergent 
res\alts of the various methodologies used in the ratings, and the. mobility 
of departments over tim^. ^ 

The American Sociologist was chosen for the source of ranking sources 
because it is the navel-gazing journal' of the profession. In the words of 

r 

its first editor Talcott Parsons, TAS was initiated, to serve "... as an 

organ of information and discussion for the professional concert of 

sociologists as a social collectivity" (Parsons 1965:2-3).. with such a 

fSfeus for the journal and the impetus provided by the American Council on 

i 

Education studies, articles on prestige within the" discipline flourished in 
TAS vintil 1976.. 

. In -n interesting turn of events, beginning with a change in editors 
and editorial policy in 19^6 TAS discontinued pub■lishi-^;^ ranking studiss . 
•The new editor Allen Grimshaw stated, - " . ' . . i „ant to declare a 
moratorium on introspective self-analysis of the stratification system of 
the discipline'- (Grimshaw 1975:192). Unfortunately for the purposes of 

« 

this study, Grimshaw did not clearly explain 'his reasons for eliminating 



this topic from the pages <?f 3>As: Subsequent editors have continiied^.this 
policy. ' . * . ; 

• The factors influencing %his' editorial decision are . open to'- 
speculation. Given -the volume of prestige related articles in TAS it is 

.possible that' sociologists had Reached their threshold of ratinq studies, 
this change in editorial policy also curi^Gsly related to the qhanging 
employment market for sociologists. .By 1976 sdciology had entered a 

■ depressed academic job market. During the late 1960s" and the early 1970s 
sociologists shared' in the benefits of the great expansion in American 

"Tiigher education. Rating studies reached tSiiir peak of visibility in the 
professional journals at that time, especially in TAS. With the downturn 
in the_ academic marketplace "in the mid 1970s ^rom which' we have not. j/et 
arisen, the number of rating studies has dimi^gi^ greatly . ^us, the 
possibility of a relationship between the bufgeoning^academ^ic marketplace 
and the increase in^rSting studies, on the one hand>^.and. the onset of a 
depressed market for sociologists and the diminished interest in prestige 
St|idies in the sociology of sociology, on ..the other hand,- seems clear. We' 
speculate that when the job market is tight the importance of prestige in 
academic careers . is lessenid for many sociologists due to the grim . 
realities of obtaining employment. 
- Thus our study of the ratings of gradu^ ^sociology departments is 

limited to the period 1965 through 1975. Whil6 this is a limitation 

inherent with TAS as the sple source of datasfor this research, it' is also - 

indicative of a dwindling interest in this aspect of the sociology of 

sociology since the mid 1970s. . . 



The ACE Stud ies 



^ ■ Before reviewing the rating studies in TAS , it is necessary to set'the 
stage by brief ly> discussing the two mcsl?- influential such studi^es 'outside 
the dojnain TaL The American Council on Education commissioned Allan 
.Cartter to conduct a national study of the gualit^ of graduate education in 
29 disciplines^and 106 i^istitutions. The CartCer study was published in 
1966. ACE la1?er commissioned Kenneth Roose and Charles Andersen to conduct 
4" five-year follow-up of the Car tter , study . The Roose-Anderson (1970) 
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Study was expanded 
and Gre^n 1980) 



cover 36 disciplines and 131 institUti^s- (Lawrence 

Both the Cartter and the-^^Roose-Andersen studies used the reputational 

i 

approach to rating graduate departments . Their «(jsthodology was to survey a 
-sample of departmental chairpersons, distinguished senior scholars and ' 
knowledgeable 3unior scholars in the disciplines .under study to rank 
graduate departments according to the quality, of ' graduate faculty and th^^ 
effectiveness of doctoral programs (L^wrende and Green 1980) . *Table 1 
presents' the rankings of the top . tferi ._3radu'at*e sociology departments 
. according to Cartter and Roose-Andeyson. 

,'As would be anticipated , the ACE studies generated a great deal of 
response. The rankings of sociology departments are of course no exception 
>- to this pattern.. As we will -see 'in the following literature' review, many 
of the' ranking studies in'.TAS are either in reaction- to the ACE studies or 
attemp'ts to test the reputational method with quantifiable indioktors of • 
quality.- ' \' * . ^ 

Since the study of the prestige or quality Of graduate programs 
paral'lqls one of the central issues iii social stratif i|ation . (i.e.. 
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mfeasuring socioeconomic states) ,^ we see a.great deal of the studies" in tas 
^attempting to test , the reputational methods of ACE with more objective 
measures such as r^earch^procLc.tivity of fa^culty or of doctoral graduates. 
That is, with the increasing emphasis of s.ociological research as a whole 
on quantrflVa-aon-and the reiatedlnovement away frogi subjective measures_of 
socioeconomic status in the stratification literature, many of the studies" 
re..iewed in this paper focus on the congruity of reputational and Objective 
measures of the quality of graduate 'education in S6ci6logy. * 
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A Review o f Rating Studies in the American Sociologist 

• . , Wanderer (1966) was the first banking of socio^lS^ departments to 



appear in The American Sociologist. In this study 'Wanderer counts the 
number of |articles, rese^ch reports, and notes per dep^ment where the 
author obtailied the .doctotate in Anprican^'socillogi'cal Review during the 
period lf^-6^;..^^Si?.is^^sed as the sole source of publication data since ^ 
it is t^^pst prestigious sociology journal. He presents a listing of 21 
schools* wHich are ranked^ among .the top 10 in contributions to )iSR in any 
one of^ t|e eleven years. l^anderer concludes that Chicagb, Columbia, 
Hairvard, and»Michigan are the' overall top four departments (see Table 2), 
He ^Iso fotmd^at these top four departments are overr^esented in ASR . 
publications "dom&ared to the number of doctorates they granted. With the 
Italriderer study we see the beginnings of the dominance of quantitative 
/quality ranking' studies in TAS.' ^ 

Lewis's (1968) research is in reaction to the Cartter study^ Lewis .is 
concerned about t^e relationship of Cartter 's findings based on the 
^^eputational T.ethod with objectiVe rankincj of departments. The top 17 
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-departments, accordirtg to .Cartter are ranked in .-this study 'by the quantity 

V 

of articles, research reports and notes, and extended commentari'es 
*" - f , , • 

pubiisHfed by faculty and " graduates ^in ASR between 1956 and 1965. Lewis 

finds a close agreement between reputational rankings and prqdufctivity 

rankings for some departments (i.e., Berkeley, Chicago , Harvard , Wisconsin 

and North Carolina) but large inconsistences for other departments (i.e., 

Michigan, Cornell, Princeton, M^Wsota, Northwestern, Yal-e> and Washington 

U.). These- discrepancies between prestige . and piroductivity are often 

related to the number of doctorates granted at each institution. Lewis 

concludes, "Regardless of objective .quality, it is mostly a department's. 

prestige that has meaning on the wider, academip scene, this surely 

determines a- school's attractiveness to promising and "potentially 

productive, graduate students, neophyte scholars, and those who dispense 

t 

research and training grants" (p. 131) 

Knudsen and Vaughan (1969) also address the issue of the 
^orrespdndence between subjective and objective* indicators of quality in 
graduate education in sociology.' Like Lewis (1968) this st^jdy was 
stimulated by* the Cartter research. Knudsen and Vaughan used all articles 
in ASR, The An^rican Journal of ■ Sociology , and Social Forces plus the 
.research notes and book reviews in ASR for the tive yelLr perioci 1960 
through 1964 as their data base.- .The authors were identified as to the 
institution at which they were, employed at the time of the publication and 
the source of their highest degree. A weighting system was devised to 
reflect the varying degrees of prestige related to different scholarly 
works.' Without discussing this -system in derail/, scholarly contributions 
were weighted in the following rank order: theoretical or research 
monographs, 'textbgoks, an edited collection or an article in ASR, an 
article in kJS ,^ an article in SF , research note in ASR . Size of the 



^ department's faculty and 'doctorates granted were controU.d^ by using the 
number of- publications per capita. 

Knudsen and Vaughan conclude that the rela^tonship between Cartter's 
reputational rankings and -their productivity based ^measures of quality is 
strong only for "the elite departments (i.,e. , ^Harvard, Berkeley, chic^o, 
,^ and Michigan) . They find substantial discrepancies between the rankings 
-basedj^n subjective and .objective methods for departments below these few 
-top schools. Again size of faculty and'' number of Phio.s granted were found 
* to be related to i!he findings of Cartter's study. Th^t'is, rankings based 
on -the absolute -number of scholarly works'^per department are similar to 
i those found with the tubjective method (see Table 2). Rankings based on 
.per capit^ ^ductivity show considerable disc^repancies with the 
reputation^ ra^ngs of departments below the elite few, however -(see 
--Table 3).^ Thus, according to l^&s^r. and Vaughan,' the subjective and 

» 

objective method's of assessing quality of graduate education in sociology 
are in agreement on the elite departments but present wide dilcrepancies on 
'the rankings qf the remainder of Ph.D.-''granting <3epartments. 

Shamblin (1970) critiques the Kriuflsen-Vaughan sJdy. Shamblin argues 
that Kfiudsen and Vaughan are not measuring qualit^A^they claim but given 
their methodology are measuring prestige as Cartter was with\-the 
reputational method. That is, Knudsen and Vaughan do not explain^, how 
publications in the three journals^^ .used in their study ^.re of hig'ljer 

. quality than' publications in other journals. They refer to these 
periodicals as tW^'leading" journals but Shamblin 'argues that publications 
in these journals are, then, an indicator of prestige, not quality. 

C Shambli^lso points out that the thfee journals used in the Knudsen 
and Vaughan study are controlled by persons from the irost 'prestigiolJ^ 



. .departmemrs. Thus, publications in these journals are an indirect indicator 
f membership "in a professional clique but not of quality. That is, 
articles in ASR, AJS, and SF are merely quantifiable measures of prestige 
as fheasured.by the s>abjective Approach, but not an independent measure of 
quality as the authors claimT Given this criticism, Shamblin cautions us 
to expect the "IcJ^^id^-Vaughan method to verify the findings of the 
reput^tional approach. • 

The apex of objective quality ranking methodologies -of Ph.D. granting 
sociology departments was achieved by Glenn and 'vjllemez (1970) . These 
abhors created the Glenn-Villemez Comprehensive Index (GVCI) " 2s a more 
all-inclusive measur^ 'of productivity th^n the measure used by Knudsen and 
Vaughan. The GVCI covers contributions to 22 journals and\ll books 
reviewed in ASR. Wei^ts were assigned to the journals based on a survey 
of a tandom sample of 250 associate professors and professors in Ph^D. 
granting d^artments listed in ,the A^SA Guide to Graduate Departments of 
Sociology, 1969. since the book productivity measure is only an indicator 
of quantity, the authors devised a weighting system to estimate the, quality 
of the department's -books based^on the scores of tk^journals ' in which 
members of the department published. This adjusted book score was used in 
the GVCI. Publications included in the GVCI cover the years 1965 through 
1968. 

^ The sample for this study consisted of th\ top 45 graduate>=de^rtments 
as 'measured by the Knudsen-Vaughan Index". ' ^ . Unlike the Knudsen-Vaughan' 
study, Glenn and Villemez consider only the^ productivity of faculty members 
in these departments. The sample i^ not restricted to Ph.I>. granting 
departments but only two programs not granting, the doctorate were included. 



^ one -goal of the study was to update the findings of Knudsen-Vaughan 
f/rom their- 1960-64 data 'base^.to the 1965-68 time period. Computing the 
Knudsen-Vaughan Index for 1965-68 data, the authors also find an elite of 
five departi,^ts but some changes within the ranks of the elite. .Wisconsin 
. had moved into this distinguished group, Berkeley dropped to sixth place, 
and Columbia move^ from "fifth to first place. A considerable' amount of 
upward and downward mot,i3.ity occurred among the other 40 depa^^tinents . The 
Xauthoi^ speculate that since the productivity scores of these departments 
are relatively similax ahd since productiv^y in many of these departments 
is primarily limited to a few faculty meanbers, that small changes in" 
personnel could strongly influence productivity scores. 

When using ^ the more comprehensive GVCI as a measure of . produotivity , 
the. authors found some discrepancies with the 1965-68 Knudsen-Vaughan Index 
rankings. The same departments were in the top five but their rank order 
was different. Based on the GVCI, Michigan raised from third to'^firs©;^ 
Wisconsin moved u^ three places to second, Columbia went from first to 
fourth, Chicago dropped/from second to third, and Harvard moved from fourth 
to fifth (see Tablj/ 2). The impressive increase , in Wisconsin's 
productivity was underscored by these findings. While Berkeley was ranked 
sixth with the' GVCI and its productivity was well b§low that cT fifth 
ranked Harvard, it was far above that of seventh ranked North Carolina. 
The authors conclude that Berkeley could, thus, be considei^d a "marginal" 
member of the elite. 

The rankings' of the other 40 departments in the sample differed 
considerably from^ the 1965-68 Knudsen-Vaughan measure, however, in 33 cases' • 
the xankings differed by at least three places. ' ^ 
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'. Glenn end Villemez also rank departments on per "person productivi/ty . 
Using this measure the top five in rank order are: Harvard, New School, 
Chicago, Michigan, and Columbia (see'; Table 3). The productivity of 
Berkeley and Wisconsin are clearly inflated by the size of thei-r faculties. 
.New School, on the other hand, was rated thirty-fifth on the GVCI before 
controlling for productivity per pereon. The ranks of. the other 40 
institutions, in the sample were not closely related when per person 
productivity was considered. ' • * . v 

While the Glenn-rVillemez study is Tiot without limitations (see pp. 
246-247 for a discussion of these limitations) , it represents the most 
comprehensive and sophisticated approach to objective measure:, . of the 
/juality of graduate education in TAS up to the Sturgis and Clemente (1973) 
study which expands the GVCI*. This improvement in quality rankings is 
primarily a result of the increased nui^er-of journals included and the 
journal Weighting system devised for the GVCI. 

In ran -article op the doctoral origins of editors of ASR, Yoels (1971) 
transiently slips in to the jJaftking game. Yoels finds what he calls 
considerable similarity between the irank^ order of the departmental origins 
of editors of ASR from 1955-65 and Wanderer •.^:^a^anking ' of the dc3ctoral 
origins of contributors t^ ASR. While Chicago, Harvard i and Columbia aS 
xn the top three in both studies, most of the other seven departments vary 
by at^least three places/ ' i ^ 

Yoels also examines the percent of ASR editors during 1963-65 with 
doctoral origins at the top five department! according |to the Cartter 
report. While Harvard, Chicago, and Columbia account for nearly 73 per 
cent of the editors of ASR at this time, Michigan contributed less than 

\ 
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three percent of the editors^d Berkeley had none of its graduates engaged 

in this aspect of the sociological enterprise. 

Oromaner (1972) tanked sociology departments on the number of 

citations their faulty received in the 1970 issues of ASR and the 1969-70 
. - issues of SF. The sample included the 79 departments that granted at least 

one Ph.D. degree from 1965 through 1969. Sixty-six of these 79 -departments 
. had members who. .were cited in at least one ASR or SF article. At the 
height "of influence in the profession were 10 departments which acco"^irted 
for 40 percent of the adthor citations (see Table 2) . . 

•vnien deparLnental ^rank measured by number of citations per faculty 
member (see Table 3) was compared to the Rcose-Anders^ (1970) ratings, 
agreement was. found only at the highest prestige levels. Harvard, 
qolumbia, and Berkeley w^ire ranked in the top five by Roose-Andersen and by 
the oromaner method. ^nlcings outside the top four showed general « 
a-greement on the broad- categories of Strong, Good, Adequate, Other, and Not 
Ranked but 'some wide discrepancies were" found also. Nebraska and Santa 
Barbara were not ranked by Roose-Andersen but were eleventh and twelfth in 
number of citations per capita. Princeton, on the oth^er hand, was rated as 
strong by Roose-Andersen but > ranked t|)irty-f if th. in citations per person. 
Thus, oromaner -s method of ranking- departments by number of citations per 

"'a 

person and the Rqose-Andersen reputational app^bach agree only on a few 
elite departments. 

Oromaner found the most often cited department was- Wisconsih. When ■ 
citations per person are . analyzed , however, Wisconsin fell to ninth place. 
Harvard, on the other hand, was seventh in citations per department but 
first in £fer capita citations. 
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Solomon (1972) studifed the relations of the Cartter and Roose-Andersen 
reputatxonal ranking with the rankings, of t)roductivity' used by 
Krtudsen-Vaughan and Glenn-Villemez. He found that the SpeSrman rank-order 
correlations of the Roose-Andersen ratings with the GVCI and the 
Knudsen-Vaughan Index gomputed for 1965-68 were" high and staiiistically 
significant. lihese findings support Lewis's (1968) contention of a close 
relationship between prestige ranking and objectively measured 
productivity. On the other hand, Solomon's findings cast doubt on the 
conclusions of Knudsen-Vaughan and Glenn-Viliemez that thes4 two measures 
of quality are not strongly related. This study supports the claim of 
Glenn and Villemez^that the GVCX is more comprehensive and refined Ijhan the 
measure of Knudsen and Vaughan since the GVCI has a higher correlation with 
the Roose-Andersen ratings. The Glenn-Villemez per person productivity 
measure had a considerably lower correlation with the 1970 ACE study than 
"did the GVCI, however. 

Solontbn (1972:14)^oncludes with a note df caution, 

There is some tendency-Jto^ thiijjc of publication productivity 
versus departmental prestige^^^as^^ dichotomous objective versus * 
subjective relation. Consideration ^oT-tMs assumption leads one 
to realize that the "importance." at^Stih^ to particular 
/ professional journals by a panel of "experts" is in some 

/respects as much a matter of subjective judgment ^as. is the 
^^ V^'^^"^/"^ graduate departments with, respect to prestige or 
";V XJu'aU . ^it would seem that the primary advantage of>^-^_ 



/^^^^^^^^ measures as criteria of departmental 
^^^^'^-^.^ ^^^y ^^^^ specific, rather than more 

^^•6Bp6^i^y^^^ prestige rankings are * 

^ 1 * 



^\^^Tj^nte (1972) reviews, ten measures of productivity used in sociology 
from^^^^'T^O-ia?! arid illustrates how different conclusions regarding 
product^rVity can be drawn from these disparate measures. He goes on to 
argue for a consensus among sociologists for the use of t^e GVCI as the 
sole measure cf productivity. • .Clemen te *'(1972:7) states that the GVCI is 

I ■ ■ ■ . 
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"composed of a broad range of journals and circumscribes most general 
sociological work as well as important specialty areas within the 
discipline. Another argiunent for its use is 'that it has a considerably 

'Wider scope than mo^t J>revious indexes ?»nd yet ^is not felectic." Cleir.ente 
thee marshals data to show that the GVCI is fair to all specialties within 
the discipline. Third, the GVCI arrives at a consensus of professional 
sociologists to base its weighting system upon. Finally, the 

- Glenn-Villemez measure is flexible^ That is; the' GVCI can be expanded to 
include more books. Clemente (1972:8) con'bludes, '"Hopefully, future 

, research in the area will incorporate the-GVCI or a similar measure/ .and 
then progress toward the real goal of the. study of productivity - grounded 
sociological^ theory - will begin." ^ 
Larson, --Petrowsky, ^ and Vandiver (1972) studied departmental 
productivity based on the publications of their graduates. In order, to 
construct a weighting system for journal publications, a survey of the 
chairmen of the top 20 graduate sociology departments as rated by Cartter^ 
was conducted asking them to identify the five journals in which they would 
prefer that their staff- published. A rank ordering of 12 journals 
resulted. Each of these journals was then examined to obtain information 
on contributors. 

Based on the productivity of ^its^ graduates ^listed in the American 

V 

Sociological Association's Guide to Graduate Departments of Sociology, 
1970, Chicago was the most productive (see Table 2); it also .graduated by 
far the largest number of productive sociologist at 99. In . total 
productivity Chicago is followed by Columbia, Michigan, North Carolina, and 
Harvard., In terms of productivity per productive Ph.!/,, North Carolina is 
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first -followed by. Michigan, Ohio State, Wisconsin', and Chicago (see Table 
3). . 



Statistically significant correlations / are found between the 
Roose-Andersen measure of the prestige of tHe degree granting, department 
and thfe productivity of both the sociologists as* a group and and the- 
departments. 

Doering (1972) is primarily concerned with productivity across 
aca-demic ranks ^but also sheds some light on departmental quality. The 
sample is limited to the top 26 departments as indicated Glenn and 
Villemez. Productivity is measured by book publication only. Doering 
found a moderate rank-order .correlation between departmental rankings based 
on his measure and t>e overall productivity rating of Glenn-Villemez . The 
correlation between Doering 's per person ranking and the per capita ratings, 
of Glenn -Villemez is sm3.11, however. 

This study ranks Berkeley first in book production followed by Chicago 
and Pennsylvania tied for second place, Columbia, and Wisconsin (see Table 
2) ? When, size of department is controlled for by calculating per person 
prbductivity, ^Haryard " ii first follwed by Berkeley, Pennsylvania, 
Columbia, and NYU (see Table 3). Chicago, drops to sixth in per person 
productivity " and WiscdiS^ drops to eighteenth place. Interestingly," 
.Michigan is hot in the. top seyeh on either of these scales. ' 

Abbott "^<(197^^li) statW, "the most fundamental issue in the 
development of departmental ratings is whether or not subjective ratings of 
quality are equivalent' to ratings based on objective 'measures of research ' 
productivity and other types of performance." .In an attempt to answer this- 
question he assesses the relationship between research productivity as 
measured by Glenn-Villemez, number of doctorates conferred during 1964-68, 
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and the size of the faculty with the Roose-Andearsen ratings. Since these 
departmental chalkcteristics account for only 57 percent of the unexplained 
variation in subjective ratings of departments, Abbott concludes that the 
reputational and objective methods are not eguiyalent. 

Abbott goes on to raise, the possibility 'that the primary referent for 
rating t1ie prestige of a department is the image of the university itself. 
This hypothesis is confirmed. ^University presti§& is found to account for 
71 percent of the unexplained variance in departmental ratings or more 
than do research productivity, do^^tes granted, or size of faculty 
^combiped.v. Extending the analysis, Abbott (1972:15) states, "Taking 
departmental and university characteristics as the explanatory and cdfitrol 
variables respectively, 'the multiple-partial coefficients- of determination 
pre .33 and .67, indicating that departmental ratings are more effectively 
Recounted for by university variables • than by departmental variables." 

Abbott (1973) studied ^the mobility of 61 sociology departments in the. 
U.S. from 1964 to 1969 using, the Cartter and Roose-Artdersen ratings', when 
analyzing movement between the-TaWo"St5Srncrf--Dx5tinguished, Strong, Good, 
Adequate, an^ Unrated- it was found that 26 percent of the departments were 
upwardly mobile, 72, percent remained in the same category and one 
department (Wa^hifig^on, St. • Louis) -moved downward. All of the upwardly 
mobile departments except Vanderbilt moved up only one category. Upward 
mobility wa^ most commmon for departments moving from^ the Good category to 
Strong. The- top five departments and all but one of the Strong departments 
remained stable. 



While the primary goal of Yoels (1973) is to assess the dissemination 
of PH.D. dissertations in. sociology , he also offers a rating'*^f departments 
based on citations of dissertations. Yo?j1s counted the number of 
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dissertations cited in ASR and AJS from 1955 through 1969. The four top 
schools were Chicago, Harvard, Michigan, and Columbia. These departments 
accounted for over 53 percent of all the citations. Thus, it appears that 
the higher the prestige, of the department from^whiah one obtained the 
Ph.D., the" greater likelihood of one's dissertation being cited^ in th^ two 
most prestigious journals. As Yoels points out, however, Chicago, 
Columbia, and Harvard dominated^ the editorial ^taffs of ASR. from 1948 to 
1968.^ In addition, AJS is based at Chicago, anS these four departments 
produce a disproportionate number of the Ph.D.s^in sociology!!"^' ' ' 

- Another high point 4n the ratings of graduate sociology departments is 
Sturgis and Clementfe (1973). This study measures departmental ' quality by 
assessing the productivity of the graduates of 50 major Ph^D. granting 
departments. The population for this study Is ^11 members of ASA who 
received the Ph.D. from Amei^ican- departments during the period 1950-1966. 
All departments granting less^an ^ten Ph.D.s in this time period were 
excluded Irom the study. A i^dified' form 'of the GVCI.was used to measure 
productivity. The GVCI was expanded to cover all books received for review 
by ASR. Data on publication records of the 2,120 sociologists in the study 
were gathered. for the period 1940-r970. 

A standardization procedure was created to control for differences in 
the number of gradu^es and the prof esjsional longevity of graduates among 
departments. Berkeley, for example, has produced more Ph.D.s over a longer 
period than Brown or Vanderbilt. "The result is the average number, of 
productivity points, articles, and, books produced by the graduates from ^ 
each jdepartment for ev6ry ten years beyond the Ph.D." (Sturgis and Clemente 
19731171). • 
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Productivity Ratings are provided on a number of measures: total 
standardized poiijli ratios, article \^atios, book ratios, percent of 
gradua.tes ever published .on the GVCI', and percent of graduates who 
published before receivino the Ph.D. Based on what -the' authors claim to be 

^t5ie best; overall indicator productivity, the total standardized point 
ratios, «hey. conclude, - " ; . .-there is no" distfnct top four or five 
departments as su5gested by other rankings ; . " (Sturgis and Clemente 
1973:174). That^ is, the authors found no distinct gaps in, total 

"productivity between departments when the stanQardization procedures, are 

applied. This finding, of course, do©<i not agree with the results of 

^ ' ■ . ...-^^ 

Cartt^r, Knudsen-Vaughagj,- Glenn-Villemez, or Roose-Andersen. 

^ The authors also conclude that their productivity measures do not * 
correspond closely with the ranking based on reputational approaches (see 
Table 2) . Nine of the top eleven according to Roose-i\n<3ersen received 
lower rankings' on the total 'standardize.d point ratios. On the other hand, 
Oregon, Vanderbiit, Pennsylvania and Brown enjoyed much higher ratings in 
this study Vhan I ii^^he ' Roi>se-Andersfin report. Thus, ^usipg standardized- 
scores V^for productivity of graduates of departments as a ^ .measuz::e of 
quaUty^^ the results differ considerably "^frqm prior ""objective and 
subjective s'tudieis.^ ^ ' 

A new dirdggtion in the ranking of graduate sociology departjnents was 
proposed by Leonard and Schmitt (1974). .They a3?gue that participation in- 
ASA meetings is a better measure of current department quality than the 
indicators used ^y others. It is also pointed out that' "... 
institutional representation at th(B national meeting is much easier to 
determine, a recurrent event, and not as dependent, upon past .performance" 
(Leonard and Schmitt 1974:40). ' / • 



is 



17 . ' ^ . 

The data base for this 'study consisted of the 1970,' 1971, an<3 1972 ASA 

i 

meetings final programs • The department of each participant was counted/ 
except in the case of two or more ^i^thors of one paper from the same 
institutibn when the- department was counted as one ynit. Forty-seven 
graduate departments emerged as the most highly represented ixfe^ the annual 



meetings, size of faculty was controlled by a calculation of contrii^tions 
per capita* Leonard and Schmitt found that these 47^ departments hafi a ^ 

relatively consistent pattern of participation in ASA meetings pver this 

- * *. 

three year period. 

After reviewing the cdrrespondence between their method of assessing 

departmental quality and those of Q^enn and Villemez * (1970); the 

Glenn-Villemez computation of the Knudsen- Vaughan Index for 1965-68; the 

Larson, Petrowsky, and Vandiver (1972) method; and the Oromanfer (1972) 

citation study, Leonard and Schmitt ^1974:41) concluc^ " • • • departmental 

representation at ASA meetings, exhibits a moderate positive association 

with "selected other indicators of the quality of Americ^fn socioiogy 

departments."* • ^ 

Pfeffer, Salanick, and Leblebici (1974) were primarily interested in 

i *• - ' 

the ^distribution of Ncitional Science Foundation funds but also of f ^r a 
potential measure \ for assessing departmental quality. After analyzing, 
pattern of the „institutional Veceipt of NSF fynds, they conclude that while 
these funds are\heavily concen^ated among a few departments each year, 
there is less stability in funding distribution over .time then inight be 
expected. More specifically, "In three of the eight years, onr^-half or. 
less of the tcp recipients were from the eight largest receivers of ^ grants 
over the pe^:jw5d" (Pfeffer, Salanick, and Leblebici 1974:197). The top 

-)/ . V 

eight £»ociology departments receiving NSF fiindl;ig in 1971 were Yale, Johns 
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Hopkins, -Columbia, Wisconsin, Michigan, Princeton, and' .Washington State 
University. Thus, another' indicator of departmental quality is developed. 

• Solomon and Walters . (1975) studied the ' causal linkages between 
prestige and scholarly productivity. The sample consists of tJj^ 38 
departments each ranked by GleW-Villemez, Cartter, and Roose-Andersen. 
Solomon and Walter^ use the prestige ranJcings of Cartter (ca- 1966) and 
Roose-Andersen (ca> 1969)^,' and the productivity ratings of Knudsen -Vaughn 
(ca. 1960-64) and Glenn-Villei^iez' (ca. 1965-68) to_,3ssess—the^ " causal 
relationship 'between department pre^ig^T'^f nd productivity ' with a 

longitudinal model. The authD'rs''conclude, ' ' " ( 

" i, 

; ... current prestige- > . . is much more dependent upon/* 

previous prestige . . . than it is olf"previ6us productivity. . . 
The above, evidence , . . . ' tends to support the' assertion that 
organization-set generated prestige orders tend not ■ only to 
determine subsequent prestige orders and to have a dominant role 
m the ' making of significant . allocative decisions within 
sociology, but furthermore, such evaluative bases tend toward' 
^particularistic evaluations andv^allocative decisions, rather than 
universalistic ones, in such (felf-perpetuating prestige orders 
(Solomon and Walters 1975:234-3^. 

/ - 'C - ' t^. 



Discussion . < ^ 

i ' , ■ , ' . / 

/ Wbat do these * studies br/ the quality of graduate education in 

sociology tell us? An overwhelming .number of "the. studies which are based ' 

on total productivity of departments point to the * existence of .an elite 

among graduate sociology departments. T^pse studies are generally in 

agreement with the ^artter- and Roose-Anderse*n reputatioriaJ..jB*«^s on the 

top departments. As indicated in several of these studies'J^ize of faculty 

and number of graduates can influence the visibility of a department and, 

I of 'bourse, the number of publications to its credit. We must also note the 

concentration of editors among the prestigious journals from these sane 
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elite \epartments . Th!^e gatekeepers of academic fame directly and 
indirectly fnfluencfe the scope of the methodologies and research topicS"^ 
- represented in these journals. That is, editors from the elite departments 
may prefer to publish papers which emphasize the methods or subject matter 
iko which they and i^embers of their professional clique have been 
socialized. As Shamblin (1970) arid Solomon (1972) poirt out, the ^se of . 
quantifiable measures of productj.vity based on a few prestigious journals 
• may merely be an indirect indicator pf ^Jrestige, nit an independent measure 
of quflity. . ^ . 

When per person productivity- of faculty and graduates is used as a 
measure of quality of graduate- education in sociology, the results' are 
somewhat more inconsistent.- V^ile the elite identified by the reputational 
studies- again dominate .th4 t6^ ten, a few newcomers "iuch as Tulane, 
Brandeis> New School, Texas • ?nd Vanderijilt join the ranks of the most 
, productive. ThUo, when^ize of ) department is controlled, the rankings of 
the top departmerts change to a ^.imited extent. ' - ' c 

. .# • when coTygsdering tHese findings, waT must reflect ^pon the suggestions 
^ . of Lewis -(1968) , W?bo|t (1§72) , and Solomon- and Walters (1975) Lew'is 
(1968:131) concluded that "\ . . it is taostly a department's prestige thaf 
has meaning on the wider academic scene." Abbott (1972) found status of 
the institution to be a bettfer predictor of departmental prestige than the 
measures of 'prod^cti(i^:y and size coil(bined . , ^ Solomon and Walters (197&) 
found that the current prestige of a department is influenced more' by 
previous ' prestige than 'by produc^vity. Thus, graduate departments of 
sociology appear to be part ".of a rather rigid stratification system, at 
, least /at the top, with institutional statb^^^nd related previous 



ERJC . \Zl 



20 



• departmental. prestige more important predictors of current prestige than is 
productivity, . ^ ^ *^ -,■ 

literature does ^ contain several important exceptions to the 
■ pattern of -at least 'general agreement between the objective studies and the 
^ ' • re^utiitiopal approach, ho^*ever. After applying a standardization procedure 

controlling ^or the number of graduates fiom a department and their " 
professional longevity, Sturgis and Cleraente (1975) conclude there is no 
distinct elite among gradual Sociology departments and that rankings based 
on their measure, of productivity do not correspond well with' the results of ' 
^ 'reputation^! studies. In addition, Knudsen and Vaughan (1969) and 

. * . { ^ ^ ' * 

Oromaner (r972) found little agreement between their productivity based 
rankings of . the non.-elite departm^ts and those using the reputational * 
' method. 



- Implications for Further Research \ 
It is our 'position that quality .ranking can b^ of use to prospective 
^graduate students, in maintaining a ptoductive rivalry between delartments, ' 
and as a reward for those upwardlyjj^mobiie (i.«., increasingly >^oductive) 
departments.' Since TAS has not .pi^lished such research since 1975 we 
advocate the need for a comprehensive ranking study of graduate departments 
in sociology to fill this gap. ' Assuming that adequate resources would be 
available, thq study should be based on the Glenn-Villemez method with the 
refinements of Sturgis -Clemeivte included.) This study should measure the 
productivity of both faculty and Ph.D. g^p^uates'. Sucft a direction in the 
u research will allow longitudinal comparisons with tlie findings of 
Glenn-Villemez and, Sturgiss-Clemente. Whi-le we have no desire to re-enter 
an era in the sociology of sdciology which is dominated by prestige 
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rankings, we. supports a comprehensive rating of graduate departments eyety 

> * 

t 

three to five years in order to. allow those interested to keep abreast of 
the*, ranking game; - * ,* . 
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TABiE 1 

1 



The American Council .op^E&ucat ion Ratings of 
Graduate Sociology Departments .'^ 



Cartter (1966)' 



Roose-Andersen- (1970) ' 



1. 


UC^ Berkeley 


1. 


Hhrvard 




V Harvard 


2. 


Michigan 


3. 


Colbqibia 


3. 


Chicago • 


4. 


Chicago ^ 


. 4. 


UC, Berkeley 


5. 


Michigan 


4. 


North Carolina 


6. 


Wisconsin 


4. 

* * 


Wisconsin 


7. 


Cornell ^ 


7. 


Johns Hopkins 


8. 


Princeton 


7. 


Princeton 


9, 


Minnesota 


' 9. 


Columbia 


10.* 


North Carolina 

/ 


- 9. 


•Northwestern 




• 


9. 


Yale 



^Sourc^^/xewis (1968) 



Sourttf: • Sturgis and Clemente (1973) 



/ 
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TABLE 2 
Depa 



Ratings of Graduate Sociology^ Departments by Total Productivity 



2. 
3. 
4, 




Knudsen-Vauv^han (19.69) 
1. DC, Berkeley 
Harvard 
Chicago 
Michigan 

5, Columbia 

6, Princeton 

7, Wisconsin 
'8 . UCLA 

Stanford 
Northwestern 




• Wanderer (1966) 

1 . Chicago 

2. Columbia 

3 . Harvard 

4 • Michigg^ 

5. Ohio.^lkte 
. 6. * University of^ Washington 
: 7. Wisconsin 

8. Yale ' . ^ 

9. UC (combined) 
10 y north Carolina 



Faculty 
Glenn-Villemez ^(1970) 



1. 


Michigan 


2. 


Wisconsin 


3. 


Chicago 


4. 


Columbia 


5. 


Harvard 


6-; 


UC/ Berkeley 


7. 


North Carolina 


8. 


Illinois 


9. 


UCLA 


10/ 


Cornell 



Graduates 



Knudsen-Vaughan (1969) 

1. Columbia 

2 . Harvard 

3. Chicago 

4. Michigan 

5. UC/ Berkeley 

6. Yale^ 

7. Noirthwestern 
.^8, Cornell 

"9. , Ohio State 

10 • Pennsylvania * 



< 



Oromaner (1972)^ 


Dcering (1972) 


1. 


Wisconsin 


1.. 


UC, Berkeley 


2. 


UC/ Berkeley 


2,5 


• Chicago 


3. 


Col\imbia 


2,5 


• Pennsylvania 


4. 


North Carolina 


4. 


Columbia 


5. 


Michigan 


5, 


v;isconsin 


.6. 


Chicago 


^6, 


^arvard 


7, 


Harvard 




^ NYU 


8, 


Yale 


8, 


Michigan 


H 


/ Northwestern 


9. 


Texas 


10. 


Johns Hopkins 


10. 


University of 








Washington 


Larson , Petronsky , 


Sturgis and Clemente 


and 


Vandiver (1972) 


(1973) 


1. 


Chicago 




UC/ Berkeley 


2. 


Columbia 




Oregon 


' 3. 


Michigan 


3. 


Columbi*^ 


4. 


North Carolina 


4. 


Vanderbilt 


5. 


Harvard 


5. 


Princeton 


6. 


Wisconsin 


6. 


UCLA 


7. 


Ohio 'state 


1. . 


Pennsylvania 


. 8. 


^•UC/ Berkeley 


8. 


Harvard 


9. 


] Minnesota 


9. 


Michigan 


10. 


' Vale 

T 


10. 


Brown / 

/ 



TABLE 3 



Ratings of Graduate Sociology Departments by Per Person Productivity 



Knudsen-Vaughan (1969) - 

1. * Harvard . ^ 

2. PrincetQn 

3. Northwestern 

4. UC, Berkeley 
5* Stanford 

6. Chicago 
?• . Michigan 
8. UCLA 
9; Brandeis / 
10. Tulane / 



Faculty 



Glenn-Villemez (1970) 

1 . Harvard 

2. New School 

3. Chicago 
4» Michigan 

5. Columbia 

6. Princeton 

7. Duke 

8. Northwestern 
8. Brandeis 

10. Wisconsin 



Oromaner (1972) 

1. Harvard ' 

2. Johns Hopkins 

3. Columbia 

4. UC, Berkeley 

5. North Carolina 
e. Yale 

'7. Chicago 

8. Northwestern 

9. Wisconsin 
10. ^ Michigan 



Doering (1972) 

1. Harvard 

2. UC, Berkeley 

3. Pennsylvania 

4. Columbia 

5 . NYU 

6. Chicago 

7. Johns Hopkins 

8. Cornell 

9 . Texas 
10. Yale 



Graduates 



1>. 


Columbia 


2. 


Vanderbilt 


3, 


Texas 


4. 


Harvard 


5. 


Pennsylvania 


6. 


UC, Berkeley 


7. 


Princeton 


8. 


Michigan 


9. 


Chicaga 


10. 


Cornell 



Larson^ Petrowsky , 
and Vandiver (1972) 

1. North Caralina 

2. Michigan 

3. Ohio State 

4. Wisconsin 

5. Chicago 

6. Columbia 
6. Harvard 

6. UC, Berkeley 
6. Yale 
6. Cornell 
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